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ASYMPTOTIC NORMALITY OF THE QUASI MAXIMUM 
LIKELIHOOD ESTIMATOR FOR MULTIDIMENSIONAL 
CAUSAL PROCESSES 

By Jean-Marc Bardet and Olivier Wintenberger 

CES (SAMOS-Matisse) , University Paris 1 Pantheon- Sorbonne, France 

Strong consistency and asymptotic normality of the Quasi- 
Maximum Likelihood Estimator (QMLE) are given for a general 
class of multidimensional causal processes. For particular cases al- 
ready studied in the literature (for instance univariate or multivari- 
ate GARCH, ARCH, ARMA-GARCH processes) the assumptions 
required for establishing these results are often weaker than existing 
conditions. The QMLE asymptotic behavior is also given for numer- 
ous new examples of univariate or multivariate processes (for instance 
TARCH or NLARCH processes). 

1. Introduction. In this paper the asymptotic behavior of the Quasi- 
Maximum Likelihood Estimator (QMLE) is studied for general M m -valued 
stationary process. The time series X = (Xf, t £ Z) is defined as a solution 
of the equation: 

(1.1) X t = M 0o (Xt-i,X t -2,...)-St + fe o (Xt-l,X t -2,...), VtGZ, 

almost everywhere (a.e.). Here Mg (Xt-i, Xt-2, ■ ■ • ) is a (m x p)-random 
matrix having almost surely (a.s.) full rank m, the sequence (£t)tgz of W- 
random vectors (£^)i<fc< p are independent and identically distributed sat- 
isfying E[^ fc) ^ fc,) ] = for k / k' and E[^ k)2 ] = Var(^ fc) ) = 1 and 
fg (Xt-i, Xt-2, ■ ■ ■ ) is a sequence of R m -random vectors. Various popular 
econometric time series models can be written in the form (jl.ip . The case 
f g = and 



i=i j=i 



(1.2) H e (X t ^i,X t -2, • • •) :— Co + 2J E ^i3 X t-i x 't-fi'i 

q k 

EX 

i=i j=i 



+ E E DijHeiXt-i-uXt-i-z, . . .)D' ip wherfk := M e ■ M' B , 
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corresponds to the BEKK representation of multivariate GARCH(g, q') de- 
fined by Engle and Kroner [13], see also Bollerslev Their natural gener- 
alization, 

CO 

He(X t -l,Xt-2, • • •) : = B + ^2 BiXt-iXt-iB'h 

1=1 

defines the multivariate ARCH(oo) processes. If Mg = 1^, a process X sat- 
isfying relation is a multivariate Non Linear AR(oo) process. 

Various methods can be employed to estimate the unknown parameter 9q. 
Maximum Likelihood Estimation (MLE) is a common one. Several authors 
studied the asymptotic behavior of MLE for particular cases of multivari- 
ate processes satisfying (jl.lj) , see for instance Bollerslev and Wooldridge [5] , 
Jeantheau |19j for multivariate GARCH((7, q') processes and Dunsmuir and 
Hannan Mauricio [22] for multivariate ARMA processes. A proof of 
the efficiency of those estimators was obtained in Berkes and Horvath pQ, 
in the case of one-dimensional GARCH(g, q'). Even if the convergence rate 
of the MLE can be optimal this method presents numerous drawbacks. For 
example, the conditional likelihood depends on the distribution of the inno- 
vations £t, which is often unknown, and on all the past values of the process 
X, which are unobserved. 

In the present paper we consider an approximation of the MLE called 
Quasi-Maximum Likelihood Estimation (QMLE). If the sequence (£,t)tez is 
a sequence of standardized Gaussian vectors, the conditional likelihood of 
X is, up to an additional constant, equal to 

1 n 

(1.3) L n (9):=--Y / Qt(0) for all G 
1 t=i 

with q t (0):= [{X t -f t e )\H t e )-\x t -f t e )+ log (det 

ft = f e (X t -i,X t -2, ■ ■ ■), Ml = M e (X t -i,X t -2, . . .) and R\ := M\M^ . 

^From now on we omit any assumption on the distribution of the 
The QMLE is obtained by plugging in the likelihood the approximations 
/* := f 6 (X t _i, ... ,Xi,u), Mg := M e (X t ^, . . . , X x , u) and U\ := M* • (M*)' 



1 Here A' is the transpose of the matrix A. 
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where u is a finitely-non-zero 



sequencd! (u n ) 



n£N : 



(1.4) L n (9):=--J2m 



t=i 



with q t (0)-=\{Xt-fe)'(Hl) 1 (X t -/*)+log(det(^))". 



The QMLE 6 n is the M-estimator associated with the quasi-likelihood L, 
given as the maximizer 



A basic idea of this paper is to restrict the set of parameters in such a 
way that moment conditions on £o imply both the existence of a solution X 
and finite moments of sufficiently high order for X. This strategy is available 
for the very general model (jl.ip thanks to a result of Doukhan and Win- 
tenberger [10], see Section [2j Then we use the moment conditions to settle 
both consistency and asymptotic normality, see Section 

We restrict the set of the parameters in such a way that we only assume 
finite moments of orders 2 or 4 on £q> which are necessary conditions for con- 
sistency or asymptotic normality, respectively, see for example Straumann 
and Mikosch [26J for some particular classes of non- linear time series models. 
In turn, these conditions guarantee the existence of moments of order 2 or 
4 of X, respectively. Notice that for one-dimensional GARCH models these 
moment conditions on X can be relaxed, see Francq and Zako'ian [15] . Berkes 
et al. [2j. For Markovian models, Straumann and Mikosch 26j achieved the 
asymptotic normality assuming moment conditions but the corresponding 
restriction on is non-explicit except for the AGARCH models. In the case 
of ARCH(oo), the conditions are not comparable with those in Robinson 
and Zaffaroni [25J. Our restriction on is stronger whereas we sharpen the 
moment conditions of order 2 + 5 to the order 2 on £o for the strong con- 
sistency. Finally, for multivariate models the conditions are sharper than 
those in Comte and Lieberman [7] and Ling and McAleer [21] who derived 
the asymptotic normality for particular models under moments of order 4, 
6 or 8 on A. In Section 0] we provide for the first time the consistency and 
asymptotic normality of the QMLE in TARCH, NLARCH and Non Linear 
AR(oo) models. 

But to begin with, the following Section [2] deals with the various assump- 
tions on the general model (jl.ip that are needed. 

2 This means that u n 7^ only for finitely many n € N. 



(1.5) 



0. 



n 



Argmax L n {9). 
eee 
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2. Notation and assumptions. In the sequel, some standard notation 
is used: 

• The symbol |.| denotes the usual Euclidean norm of a vector or a 
matrix (for A a (n x p)-matrix, ||j4|| = sup^y^ {||Ay||, Y £ 

• For the measurable vector- or matrix- valued function g defined on 0, 
ll^lle = sup eee \\g{9)\\; 

• If V is a vector space then V°° denotes the set of the finitely-non-zero 
sequences x i.e., there exists N > such that x = (x\, X2, ■ ■ ■ , xn, 0, 0, . . .); 

• The symbol denotes the null sequence in M N ; 

• If V is a Banach space and is a subset of M. d then C(0, V) denotes the 
Banach space of ^-valued continuous functions on O equipped with 
the uniform norm || • ||@ and L r (C(G, V)) (r > 1) denotes the Banach 
space of random a.e. continuous functions / such that E[||/||2] < oo. 

2.1. Definition of the parameter sets 0(r) and B(r). In proposition [T] 
below we provide the existence of a stationary solution of the general model 
(jl.lh . Two conditions of different types are used: the first one is a Lipschitz 
condition on the functions / and M in (jl.ip . the second one is a restriction 
on the set of the parameters. 

Let us assume that for any 6 € M d , x i— ► fe(x) and x i— > Mq{x) are Borel 
functions on (M m ) 00 and that Rank Mg(x) = m for all x G (M m )°°. Assume 
that there exist two sequences (aj(f,9))j>i and (oj(M, #))j>l satisfying, for 
all x, y in (R m )°°, 

\\fe(x)-fe(y)\\ < E£i«;(/,0)N-!/;l|, 
\\M e (x) - M e (y)\\ < T,jLi aj(M,6)\\xj - yj\\. 

For some models, as mentioned in remark 12.11 it can be more efficient to 
replace the condition on M by the existence of a sequence (atj(H,0))j>i 
such that 

oo 

\\H e (x) - Hg(y)\\ < oij(H, 9)\\xjXj - yjy'jl 
i=i 

where Hg := Mg-ML Assuming E||£o|| r < +°o for some r > 0, we can define 
the set 

!oo oo 
6eR d / X>i(/,0) + (E||6ID 1/r E^( M ^) < 1 
j=l 3=1 

This set depends on the distribution of £o via the moments E||£o|| r - But 
thanks to the fact that E[^ k) ^ k ' ] ] = fox k^k> and E[^ fe)2 ] = Var (^ k) ) = 
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1 the set 0(2) simplifies: 

{oo oo 
e G R d I a jV> °) + VpY, 9) < 1 

Proposition 1 If Oo & 0(r) for some r > 1 there exists a unique causal 
(Xt is independent of (£i)i>t f or t G X) solution X to the equation (jl.ip 
which is stationary and ergodic and satisfies E||Xo|| r < oo. 

This result generalizes the one proved by Giraitis et al. [16] for ARCH(oo) 
models. It automatically yields weak dependence properties, see [10] for de- 
tails. For such non Markovian models, the classical Lyapunov condition of 
Bougerol [6] cannot be applied. 

Let us now consider the special cases of (jl.ip where / = 0, m = p = 1 and 
there exists a Borel function Hg such that Hg[x) = Hg(x 2 ) for all x G M 00 . 

Corollary 1 The result of Proposition^ holds if Oo S 0(r) for r > 2 where 

!oo 
0£R d I E|£o| r (£a 3 -(tf,0)) r/2 <1 

Remark 2.1 The ARCH(oo) process was defined by Robinson [24] as so- 
lution of the model: 



(2.3) X t = o£ u °l = M#o) + E 5 #o)Al 



2 



-J ' 



i=i 



where, for all G {bj{0))j>\ are sequences of non-negative real numbers. 
Here, / = 0, p = m = 1, aj(M, 0) = Jh^O) and aj(H, 0) = bj(0). Working 
with the set 0(r), larger than 0(r), gives more general results. 

2.2. Uniform assumptions on 0. Fix some compact subset of M. d . For 
any sequences x, y of (M" 1 ) 00 , the functions \— > and # i— > Mq(x) are 

assumed to be continuous on 0. As in [26], uniform continuity conditions on 
are required to apply the QMLE procedure, see LemmaCDof the Sectional 
Assume that ||/e(0)||e < °o and ||Mg(0)||e < oo. To settle the assumptions 
in a short way, let us introduce the generic symbol for any of the functions 
/, M or H. 

(Al(^)) Let aj(^) = sup^e aj(^, 0) be such that J2j>i «j W < 00 • 



G 
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(A2) There exists H_ > such that M eeQ det (H e (x)) > H_ for all x G 



(A3( X I / )) The function G i— > ^g(x) is 2 times continuously differentiable 
for all x G (M. m )°° and 



0*e(O) 



50 



+ 



dOdO' 



< oo. 



Moreover assume that there exist two integrable sequences (aj . >v 
i = 1, 2, such that for all x, y G (IR" 1 ) 00 



90 00 



9090' 



e 







3=1 



If \I/ = ii", [|scj — in the RHS terms is replaced with ||xjXj 

The last assumption on the derivatives is just needed for the asymptotic 
normality of the QMLE. 

2.3. Identifiability and variance conditions. We assume the same identi- 
fiability condition as in Jeantheau |19j : 

(Id) For all G 9, (/* = /*, and H* = a.s.) = O . 

(Var) One of the families {dfl Q /dOi)i<i< d or (dH% /d6i)i<i< d is a.e. linearly 
independent, where: 



df[. = dfe 



t-l, ■ 



and 



dd 



d9 



t-l, 



The condition (Var) is needed for ensuring finiteness of the asymptotic 
variance in the result on asymptotic normality. For ARCH(oo), Robinson 
and Zaffaroni [25] give sufficient assumptions for both (Id) and (Var). They 
are easier to verify than (Id) and (Var) but are not as general. Alternative 
conditions similar to those for ARCH(oo) are not straightforward in the 
general model (jl.lj) because of its non-linear character. 

3. Asymptotic behavior of the QMLE. If the model satisfies the 
conditions of Corollary [TJ the set 0(r) can be replaced with 0(r) in all the 
results of this section. 
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3.1. Invertibility. Here we follow the presentation of Straumann and 
Mikosch [26]. The approach of the QMLE is based on an approximation of 
ft = E(X t | ■ ■ •) and Hg = E((X t -/*)(X t -/*)' | X t _i, X t _ 2 , . . . ) 

by fg and Hg, defined as in the introduction. Invertibility is the property 
that fl and Hg converge to the unobservable fg and Hg, see Section 3.2 
of [26] for more details. The following lemma states this result which is a 
necessary step in the proof of the QMLE consistency. 

Lemma 1 Assume that 6$ G 0(r) for r > 2 and that X is the stationary 
solution of the equation (jl.ip . 

1. //(Al(f)) holds then fg G h r (C(Q,R m )) and 

(3.1) E[||/*-/*|r e ] <E[||X |r](£«;(/)) r forallteW. 

3>t 

2. If (A1(M)) holds then Hj G TL r / 2 (C(Q,M m )) and there exists C > 
not depending on t such that 

(3.2) E[||^-^||e /2 ] < c(^a i (M)) r/2 for all t € N*. 

3>t 

3. //(A1(H)) holds then Hg G L r / 2 (C(9, 7W m )) and 

(3.3) EiWH'g - H^ 2 ] <E[||X |r'](E^(^)) r/2 /ora/ZtGN*. 
Moreover, under any of the two last conditions and with (A2), Hg is an 



invertible matrix and 



{Hi 



< Hr l/m . 

e 



The proof is given in Section 15.11 

3.2. Strong consistency. In the following theorem, we assume by con- 
vention that if (A1(M)) holds then aj(H) = and if (A1(H)) holds then 
ay(M) = 0. 

Theorem 1 Assume that 9q G for a compact subset C 0(2). Let X be 
the stationary solution of the equation (jl.ip . Let (Al(f)) ; (A2) and (Id) 
hold. Moreover, if (A1(M)) or (Al(f)) hold with 

(3.4) aj {f) + Oj(M) + aj(H) = 0(r £ ) for some £ > 3/2, 

then the QMLE 9 n defined by (11. 5ft is strongly consistent, i.e. 6 n — 9q. 

n— *co 

The proof is given in Section 15.31 
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3.3. Asymptotic normality. We use the following convention: if (A3(M)) 
holds then aj ] {H) = and if (A3(H)) holds then af ] (M) = 0. 

o 

Theorem 2 Assume that 6 G0 with 0C 0(4) where denotes the interior 
of a compact subset C M. d . Let X be the stationary solution of the equation 
(jl.ip . Assume that the conditions of Theorem [7] and (A3(f)), (Var) hold. 
Moreover, i/(A3(M)) or (A3(H)) holds with 

(3.5) af\f) + af ) {M) + af '(H) = 0{j- 1 ') for some £' > 3/2, 
then the QMLE 6 n is strongly consistent and asymptotically normal, i.e., 

(3.6) V^(e n -e ) ^ M d (0 , F(e )- 1 G(9 )F(9 )- 1 ), 

n— >oo 

where the matrices F{6q) and G(6q) are defined in (|5.10p and (|5.14p respec- 
tively. 

The proof is given in section 15.41 

4. Examples. In this section, the previous asymptotic results are ap- 
plied to several examples. For ARCH, GARCH, AR and GARCH-ARMA 
processes, the consistency and asymptotic normality have already been set- 
tled and we compare the different conditions from the literature with ours. 
For other examples, such as TARCH, multivariate ARCH and NLARCH 
processes, the consistency and the asymptotic normality of the QMLE are 
novel results. Examples satisfying the conditions of Corollary [1] are studied 
first. 

4.1. ARCH(oo) processes. By Remark 12.11 the set 0(r) is well-adapted 
to that case 

I 00 — 2/r I 

(4.1) e(r) = hem d / $>(*) < (E[|&n) J. 

For #0 G 0(r), the existence of a stationary solution and of its r-th order 
moments is also settled in Giraitis et al. [16] . For an excellent survey about 
results and applications of ARCH models, we refer the reader to Giraitis et 
al. [18] . Here we formulate a version of Theorems Q] and [2] adapted to the 
context. 
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Proposition 2 Let O be a compact subset of 0(2) and X the stationary 
solution of (|2.3p . Assume that infg e @6o(^) > and that 9 i— > bj{6) be con- 
tinuous functions satisfying 

sup bj(6) = 0(j~ e ) for some £ > 3/2. 
eee 

1. If (Id) holds then the QMLE 9 n is strongly consistent. 

o o ~ 

2. Assume that 9q £0 with ©C B(4), that £g has a non- degenerate dis- 
tribution. Let the functions 9 i— > bj{6) be 2-times continuously differ- 
entiate on for all j £ N satisfying for all (k, k') £ {1, . . . , o!} 2 ; 



sup 

6»ee 



0(j ^ ) /or some > 3/2 and sup 



3>i 0ee 



< oo; 



50* 

If there exists a finite subset A C N stic/i that 

(4.2) ^ — ^ — ^ ^ is linearly independent, 

then the QMLE 9 n is asymptotically normal, i.e., it satisfies ()3.6p . 

For the asymptotic normality of the QMLE we use the condition in equation 
(|4.2p coming from Robinson and Zaffaroni [25] that ensures both (Id) and 
( Var) . Let us compare the results of Proposition [2] with those of Theorems 
1 and 2 in Robinson and Zaffaroni [25] . Those authors obtained the almost 
sure convergence of the QMLE under moments of order r > 2 (instead of 
r = 2 here) and a decreasing rate j~ e with i > 1 (instead of I > 3/2 here) 
for the sequence (sup^gQ \bj(9)\)j>i- Concerning the asymptotic normality 
for r = 4, their conditions on both the first derivatives of 9 t— > bj{9) are 
the same as in Proposition [21 They required also conditions on the third 
derivatives (nothing like this here). 

4.2. GARCH(g, q') models. The GARCH(g, q') models have been intro- 
duced by Engle [12]. Here X is the stationary solution of 



(4.3) X t = atCt, of = co(9 ) + Y, c o^) X t-i + £ d #oK%, 

3=1 3=1 

where Cj{9) and dj(9) are non negative real numbers for all 9 £ 0. This 
model can be embedded in the class of ARCH(oo) models (see Giraitis et 
al. [H]), as one needs to set for all z £ C 

(4.4) b (9) := ^ and := ■ 
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In the last formula, both the polynomials are supposed to be coprime. The 
results of Theorems Q] and [2] lead to the consistency and asymptotic nor- 
mality of the QMLE in that case. However our conditions are not as sharp 
as those in Berkes and Horvath [I], Francq and Zakoian [15] or Straumann 
and Mikosch [26J. As a consequence of the expression (14. 4h . the sequence 
(sup eg @ bj(6))j decreases exponentially fast to and A1(H) holds auto- 
matically. From Corollary [H if 9q G 0(r), where G(r) is defined as in (|4,ip . 
the GARCH process has solutions of order r as for ARCH(oo). For instance, 
if q = q' = 1 and 9 = (co,ci,di), we achieve the optimal condition of ex- 
istence of a second-order stationary solution as ©(2) = {c\,d\ such that 
c\ > and c\ + &\ < 1}. In the property below, we use the identification 
condition of Francq and Zakoian [15J. 

Proposition 3 Assume that G is a compact subset of 0(2) defined in (|4.ip 
and that X is the stationary solution to (14.3j) . Assume that inf# g cq(6) > 0, 
that 9 i — > Cj(9) and 9 i— ► dj(9) are continuous functions injective on G for 
all j. //£o has a non degenerate distribution then the QMLE 9 n is strongly 
consistent. 

o o ~ 

Moreover if 9q GG with QC G(4), the functions 9 \— > Cj(9) and G \-* 
dj{9) are 2 times continuously differentiable on Q satisfying for all (k,k') G 

{i,...,4 2 , 

dbj(9) „ #6,(0) 

sup ^7 = 0(7 ) for some f > 3/2 and > sup — ^ < oo. 

then the QMLE 9 n is also asymptotically normal. 

Our assumptions induce the finiteness of second order moments of X. How- 
ever Jeantheau [19] proves that moment conditions for models satisfying the 
Markov property are not needed for the consistency of the QMLE. In the 
case 9 = (co, ci, . . . ,c g ,di, . . . , d q i) the Proposition [3] simplifies: 

Proposition 4 Assume that Q is a compact subset of Q(2) and that X 
is the solution of (|4,3p . Then, if £ 2 has a non- degenerate distribution, the 

^ o o ~ ^ 

QMLE 9 n is strongly consistent. Moreover if 9q GQ with QC Q(4), then 9 n 
is also asymptotically normal. 

4.3. TARCH(oo) models. The process X is called Threshold ARCH(oo) 
if it satisfies the equations 



(4.5) X t = a£ t , 



ASYMPTOTIC NORMALITY OF THE QMLE FOR CAUSAL PROCESSES 11 

oo 

<r t = b (0 ) + [ b t( e o) wBx(Xt-j,0) - bj(8 ) min(X t _ i , 0)] , 
3=1 

where the parameters bo(9), bj~(0) and b~(9) are assumed to be non nega- 
tive real numbers. This class of processes is a generalization of the class of 
TGARCH(p,g) processes (introduced by Rabemananjara and Zakoi'an |23j ) 
and AGARCH(p,q) processes (introduced by Ding et al. [8j). Here 

0(r) = 1 9 E M d I pma X (bj(9),b+(9)) < (E[\^~ 1/r 

since ctj(M,9) = max (bj(9), bj~(9)). Consequently, we can settle for the 
first time the strong consistency and asymptotic normality of the QMLE for 
TARCH(oo) models: 

Proposition 5 Let be a compact subset of ©(2), X be the stationary 
solution to (|4.5p and assume that (Id) holds. Assume that infg g @&o(^) > 
and 

supmax(bj(9),bf(9))=0(j~ i ) for some £ > 3/2, 
eee 

then the QMLE is strongly consistent. 

o o ~ 

Moreover if 9q E0 with OC 0(4), assume that the functions 9 ^ bo(9), 
9 i — ^ bj(9) and 9 bj(9) are 2 times continuously differentiable on 
satisfying, 



sup max ( 



db+(p) dbt(9) 



d9 k ' d9 k 



0(j £ ) for some £' > 3/2 and 



/ d 2 b+(9) d 2 b~{9) N 



j>l<?6© 



If (Var) holds then the QMLE 9 n is also asymptotically normal. 

4.4. Multivariate ARCH(oo) processes. The multivariate ARCH(oo) pro- 
cesses are defined as solutions to equation where 

oo 

(4.6) H e (X t ^,X t _ 2 ,...) := B (9) + Y J B i {8)X t ^X' t _ l B' i {9). 

i=l 

Here Bi(9) is a non-negative definite d x d matrice for all 9 E As 
ay(M,0) = Bj(9) we have 

(4.7) e(r) = kl rf / EBiCOXfEOl&in'" 1 "' 
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Proposition 6 Let be a compact subset o/@(2) and X be the stationary 
solution to (jl.ip when relation (|4.6p holds. Assume that infgge det Bq(9) > 
0, (Id) holds and 

\\B j {6)\\ e = 0{r i ) for some i > 3/2. 
Then the QMLE is strongly consistent. 

o o ~ 

Moreover, if 6$ £0 with OC 6(4), assume that the functions 9 i— ► Bj{6) are 2 
times continuously differentiable on Q satisfying for all (k, k') £ {1, . . . , cf}- 2 , 



&B,(0) 



0(r'') /or some > 3/2 and ^ ^ j < oo. 
d9 k e f^^dOkdOy e 

// (Var) holds, then the QMLE 6 n is also asymptotically normal. 

For the best of our knowledge, the asymptotic behavior of the QMLE for 
such models is studied here for the first time. 

4.5. Multivariate GARCH(g, q') models. Multivariate GARCH(<?, q') mod- 
els refer classically to both VEC and BEKK models. We refer the reader to 
Section [4.81 for VEC models which are subcases of ARMA-GARCH models. 
BEKK processes are solutions of equation (|4.6p or equivalently 

q p 

vec{H t ) = vec(C ) + £ C i (0 o )^ec(X t _ i ^_ i ) + £ A(0 O )W(iI t _;), 
i=i i=i 

where vec is the operator that stacks together the columns of a matrix. For 
any pxk matrix A: A* = J2j=i Aij®Aij for i = 1, . . . ,p, where ® denoting 
the Kronecker product. The multivariate ARCH(oo) representation holds 
with Bj satisfying 

-1 



(4.8) B *:=(l-$>;)xC * and 



3=1 



^ 5*^ := (l - D*Z^ x 1 ^ C*^ for all Z £ C 
In the last formula, both the polynomials are supposed to be coprime. 



The natural choice 9 = (Co, C\, . . . , C q , D%, . . . , D q >) implies that (A1(M)) 
and (Var) are satisfied. Using the identification condition of Comte and 
Lieberman [7J, Proposition [6] becomes more simple: 
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Proposition 7 Let be a compact subset o/G(2) defined in (14.71) and X 
be the stationary solution to (jl.ip when relations (|4.6p and (|4.8p ZioZd 7/ 
infe G e det Co(0) > and (Id) holds, then the strong consistency holds. 

o o ~ ^ 

Moreover if 6q G0 luzf/i 0C 0(4), i/ien # n is also asymptotically normal. 

The asymptotic normality was settled before by Comte and Lieberman [7] 
for r = 8. Our result needs just moment of order r = 4. 

4.6. Multivariate NLARCH(oo) models. Let (Bj(8)) . >1 be a sequence of 
m x d-matrices and Bq(9) be a vector of M m . The multivariate LARCH(oo) 
models introduced by Doukhan et al. [9] are extensions of the univariate 
LARCH(oo) models of Giraits et al. [TT] . They are defined as the stationary 
solution of the equation: 



x t = (t(B (e ) + X>#o)x t _ j 

Notice that the innovations (Ct)tez are here random matrices. In this context, 
the QMLE is not a suitable estimator since inf# g e det (Hg(x)) = except 
in very specific cases. However, Doukhan and Wintenberger [10] proposed 
a generalization of LARCH(oo) models, so-called NLARCH(oo) models de- 
fined by the equation 

oo 

(4.9) X t = Ct(B (9) + Y / B J (e,X t - j )), 

3=1 

where now Bj(6, .) : R m — ► R p are 6j(#)-Lipschitz functions. If the matrices 
of the innovations are concentrated on the diagonal, we rewrite (I4.9P as 

Xt = Mg (X t -i, X t -2, ■ • -)6> 



oo 



where = (&) M and (M fl (X t _i, AV 2 , . . .)) = 5 ir (B (9)+ £ B k (9, X t - k )) .. 

J k=l 

For instance, consider the multidimensional extension of the TARCH models 
as 

m 

(Bj(0, x)) k = B+ k ft) max(x i)4 , 0) + Bj ki {e) mm(x jti , 0), 

i=l 

where Bj~ k i and Bj k i are non-negative real numbers. For NLARCH(oo) 
models we have 

0(r) = \eeR d / Y,u Px (B J (e,x))<(E[u \r ^ > 1 
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Proposition 8 Let be a compact subset of 6(2), X be the stationary 
solution to (|4,9p and assume that (Id) holds. Assume that for all j G N, the 
vectors Bj(9, .) G [0,oo[ p , mf de@ ||-B O (0)|| > and for all j G N*, 

11^(5,(0, x))|| e = 0{r l ) for some I > 3/2, 

i/jen i/ie strong consistency holds. 

o o ~ 

Moreover if 9q G0 mt/i 0C 0(4), assume that the functions 9 Bj(9,.) 
are 2 times continuously differentiable on and satisfy 

LiPx ^A\\ =0{r e ) wtth £'>3/2 
ot>k we 

and V \\Lip x 9 ^na^ < 00 ^ or a ^ ( fc > k> ) G i 1 , • • • '4 2 - 
11 ov k cW k > 

If (Var) holds, the QMLE 9 n is also asymptotically normal. 

4.7. Multivariate non-linear AR(oo) models. Let us focus on one exam- 
ple where M = I m and / ^ 0. In this context, (A1(M)) is always satisfied 
and the QMLE coincides with the least squares error estimator. Here, we 
restrict ourselves to the cases where 

oo 

(4.10) fe{X t -i,X t - 2 ,...) = A (e ) + Y / MOo,X t ^ i ), 

i=i 

where Ai(9, .) are Lipschitz functions with values in positive definite d x d 
matrices. Here 0(r) neither depends on r nor on the distribution of £o : 

0(r) = | 9 G R d j fj Lip^fl, x) < 1 1 . 



Proposition 9 Let Q be a compact subset of 0(2), X be the stationary 
solution to (II. lj) iu/ien M = I m and (14. 10|) holds. Under (Id) and i/ /or 

i G N*, 

||.Lip a ..Aj[| e = 0(j~ E ) for some £ > 3/2, 
i/ien £/ie strong consistency holds. 

o o ~ ^ 

Moreover if 9$ G0 uni/i 0C 0(4), n is also asymptotically normal as soon 
as functions 9 i— > Aj(9,x) are 2 times continuously differentiable on /or 
all x G M m , (Var) /iotas and 
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dA ■ i 
Lip^-Trr- =0(j~ i ) for some £' > 3/2 and 
d6 k e ' 



11 OttkVk' © 



i=i 



A'' 



4.8. Multivariate ARMA-GARCH models. Here Mg is concentrated on 
its diagonal and / is not necessarily identically zero. If / = 0, the model co- 
incides with the VEC-GARCH model, see Jeantheau [19]. Multidimensional 
ARMA-GARCH processes were introduced by Ling and McAleer [21] as the 
solution of the system of equations 



(4.11) 



<Z>g(L) ■ X t = * e (L) ■ s t , 
e t = M (A t _ 1 ,A t _2,...)6, 



with diag(i^) = C o (0) + Ef=i C i (0)6Aa S (e t - i E , t _ i ) + Ef=i A (0)diag (if*-*). 
Here Co(9), Ci{9) and Dj(9) are positive definite matrices, diag^4 is the 
diagonal of the matrix A, <&g(L) = I m - $iL — • • • — 3> S L S and ^e(L) = 
I m — ^>\L — ■ ■ ■ — *$> S 'L S are polynomials in the lag operator L and $j and 
\& j are squared matrix. We define for all 9 G M rf 

oo 

T g (L) := Im + J^^W = %\L)<S> e {L) 

i=l 

oo q' , q 

and ^Bi(Q)Z l := (l - ^ Di(6)Z % ) ^^C t {9)Z l for all Z G C m , 

i=l i=l i=l 

where the polynomials of the right hand side are assumed to be coprime. 
The equation (14.111) has the representation (jl.ip with fg(X t ~i, X t -2, ■■■)■= 
J2Zi Ti(e)X t -i. We can define, 

!oo 1/r 00 

9 G R d j £ [|r 4 (0)|| + (E[[|&in) E \\Bj(P)W < 1 
i=i j=i 

If 9q G 0(r) then the existence of a solution is ensured. This existence 
condition is more explicit than the one of Theorem 2.1. of Ling and McAleer 
[21] . Now we give a version of Theorems [1] and [2] when 



9 = ($i, . . . , $ s , *i, . . . , Sv, C , Ci, ■ • • , C q , D 1} . . . , A,/). 
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Proposition 10 Let O be a compact subset of 0(2), X be the stationary 
solution to the system (|4.1ip . If infg g @ det Cq(6) > and (Id) holds then 
9 n is consistent. 

o o ~ ^ 

Moreover if 9q 60 with 0C 0(4), 9 n is also asymptotically normal as soon 
as (Var) holds. 

Ling and McAleer [21] also provided consistency and asymptotic normality 
of the QMLE. Proposition 1101 improves their results. Notice that for VEC- 
GARCH models, Jeantheau pj5] provided the consistency under a weaker 
condition. 

5. Proofs. In this section the proofs of the main results are collected 
in the order of appearance in the paper. First we prove Proposition Q] and 
Corollary [H then Lemma [T] that settles the invertibility of the QMLE. With 
the help of this property we prove the main theorems that state consistency 
and asymptotic normality of the QMLE. 

5.1. Proofs of Proposition^ and Corollary^ We apply a result of Douk- 
han and Wintenberger [10] that gives conditions for the existence of a sta- 
tionary solution of an equation of type 

(5.1) X t = F(X t _ l ,X t „ 2 ,...;£ t ) a.e. for all t E Z. 

If E||foir < oo and F satisfies for x = (si)i>i, y = (|/»)i>i E (R m )°°, 

• E||F(0;£o)ir <oo; 

• [E\\F(x ;€q) - F(y ;£a)\\ r ) < ^ dj\\xj - yj\\, with ^ aj < 1; 

j>i j>i 

the existence of a unique causal stationary solution X of (|5.ip . such that 
E[||X || r ] < oo is proved in [10J. We identify F from (fLTjk 

^(■Xt-ii-Xt-a) •••;&) = M9 (^t-i)-^t-2) • • •) • 6 + fe (Xt-i,X t -2, . . .). 
Obviously, E[||F(0; Co)|| r ] < oo if E||f |r < oo and we have 

(E||F(x;eo)-^(y ;eo)ir) 1/r 

< (E\\(M 6o (x) - Me (y)) ■ £o|r) Vr + Il/«o0»0 " feMW 

< (E||Coir) 1/r H^o(^) - M 0o {y)\\ + \\f 9o {x) - fe (y)\\- 
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The condition of Proposition [T]then implies those of [10] on F. In the context 
of Corollary [H from Hq(x) = Hg(x 2 ) for all x = (xj)j>\ G we have 

CO 

\\Hg(x) - H e (y)\\ < ^2 a j(H, 0)\\xj — t/j\\ and, 

3=1 

(E[|M| (x)e 2 - Mimi\ r,2 ]) 2,r = (E[icoii) 2/r i^o(^) - ^ (y 2 )i 

CO 

< (E[icon) 2/r E«°(^^)i^-^i. 

The results of [10] yield the existence in U'l 2 of the solution (X t 2 ) tg ^ of the 
equation 

Xl = Ml(X t ^,X t ^,...)^ = He^Xl^xU,...)^ a.e. 

Moreover, by [10] there exists a measurable function <p such that = 
ip(£t, £t-l> • • •) f° r all t € Z. The ergodicity of X follows from the Proposition 
4.3 in Krengel [2D] ; it states that if (E,£) and (E,£) are measurable spaces, 
(vt)tez is a stationary ergodic sequence of -E-valued random elements and 
ip : (E , £ ) i ^ {E,£) is a measurable function then the sequence {vt)t& 
defined by vt = (p(vt,vt-i, . . .) is a stationary ergodic process. 

5.2. Proof of LemmaUl We treat the three assertions of the lemma one 
after the other. 

1. Define f/ = f e (X t ~i, . . . , X t - P , 0, 0, . . .) for all t G Z and pel We 
have f/ £ L r (C(G, M m )) because 6 £ 9(r) and, using Corollary [Q all the 
following quantities are finite: 

(E[||/^ir e ]) 1/r < (E[||/r-/^lle]) 1/r + (E[||/rile] Vl ' 



< 



51 (E[ii^oir]) 1/r + ii/^(o)ii 



8- 



For p < q 

E[||/^-/^|r e ]<E[| Yl atjWXt-jf] <E[pT |n( yi 

p<j<q p<j<q 

Since J2j>i a j(f) < °°j (fe' P )p>o satisfies the Cauchy criteria in L r (C(0, M m )) 
and it converges to ff°°, that is fjj on a{X tl , . . . ,Xt n ) for all n G N* and 
£ > > • • • > t n (those (T-algebras generate a(X t -i, X t -2, ■ ■ •) and therefore 
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SI 



t,oo 



~a.s fe)- 



2. Define H l f = H 6 {X t -i, X t - V , 0, . . .) for all p G N and t G N. Prom 
Corollary [H 9q g G(r) and common inequalities satisfied by matrix norms, 
H f / G h r / 2 (C(Q,M m )) since, denoting M*' p = M e (X t ^, . . .,X t _ p ,0, . . .), 



|^' P He /2 < \H P \\ r e < (\\M e (0)\\e + £ ||* 



We conclude as above that Hg G L r / 2 (C(6, M. m )) by bounding, for p < q, 

\\Hl' p - H^\\% 2 < \\Ml' p - M^ 2 (\\Ml' p \\% 2 +\\M^ 
The Cauchy-Schwarz inequality implies that 

1/2 



:,g 11*72 



< 



(E[\\M t 

b(e[( J2 <*AM)\\X; 



e He. 



1/2- 



p<j<g 



<S(E[||X |r]) 1/2 ( £ «,(M) 



1/2 
r/2 



for some constant B > 0. 



3. First notice that ||A^oXq|| < UXoll 2 . Next, as in the previous proofs 
(Hq P ) p ^* converges to H l e in U/ 2 (C{Q,M. m )). Thus there exists a subse- 

|e 



quence (pfc)fceN such that \\Hg Pk — -ffglle 0. Thanks to the continu- 



k— >oo 



ity of the determinant, (det H g ,Pk )k£N also converges a.s. to deti^. Then 
det Hq > ^ , is an invertible matrix and in view of elementary relations 



between matrix norm and determinant 



e 



< if -1 /™. 



5.3. Proof of Theorem \Q The proof of the theorem is divided into two 
parts. In (i) a uniform (in 9) law of large numbers on (qt)teN* (defined in 
COD) is established. In (ii), it is proved that L(9) := -E(q t (9))/2 has a 
unique maximum in 9q. Those two conditions lead to the consistency of 6 n . 



(i) Using Proposition [H with q t = G(X t , X t -i, ■ ■ ■), one deduces that 
(qt)tez (defined in (jl.3p ) is a stationary ergodic sequence. ^,From Straumann 
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and Mikosch [26j, we know that if (vt)tez is a stationary ergodic sequence of 
random elements with values in C(0, R m ), then the uniform (in 6 £ 0) law of 
large numbers is implied by E[|uo||e < oo. As a consequence, (qt)tez satisfies 
a uniform (in 9 £ 0) strong law of large numbers as soon as Efsup^ |<Zi(#)|] < 
oo. But, from the inequality log(x) < x — 1 for all x £]0, oo[ and Lemma [H 
for all t £ Z, 



(5.2) 



m M_i 



for all 9 £ 



log# 



+ m x 



|i#l 



e 



But for all t £ Z,E||X t || r < oo, see Corollary[H and E[||/*||^] +E[||F*||@ /2 ] < 
oo, see Lemma [TJ As a consequence, the right hand side of (|5.2p has a finite 
first moment and therefore 

E[sup|gt(0)|] < oo. 

The uniform strong law of large numbers for (qt(9)) directly follows and 
hence 



(5.3) 



L n {9) 



n 



L{9) 



^ with L(9):=--E[q (9)). 

n^oo 2 



Now, one shows that — \\L n — L n ||e — 0. Indeed, for all 9 £ and t £ N*, 
~ qt(0)\ 

= ( log det Hi - log det fl|) + (X t - ' 1 (X ( - /|) 

-{X t - fl)\HlY\x t - fl) 

< \C\~ X \ det - det (Hl)\ + (X t - ^[(H*)- 1 -^)- 1 } (X t - ft) 
+ (2X t -f e -fl)'(Hl)-\fl-Jt) 



< H 



-i 



det(fl|)-det(fl|) + 2(||X t || + ||^|| )||(i%) I (fl*)" 



e 



ie 



(5.4) +(2||X t || + H/'lle + ll/JHe) HM'lell^ " I 



e\\e 



by the mean value theorem, with C £ [det (Hg) , det (H^)] and therefore 
|C| > H_. On the one hand, 



hit 1 - {K) 



< 



(H, 



t\-h 



II U ^ U I- II 
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On the other hand, for an invertible matrix A G «M m (R), and H G Ai m \^j, 
det{A + H) = det(A) + det(A) ■ Tr^ 1 )'//) + o(\\H\\), 

where | Tr ( (^4~ 1 ) | < || v4_— 1 1| • Using the relation ||(#*) _1 || e > H~ m 
for all t G Z, there exists C > not depending on i such that inequality 
(15.41) becomes: 



e 



su V \q t {9)- qt {6)\ <C(||X t || + ||/*||e + ||/ e t ||e)x (11^-^1^ + 11/^-/^1 

^From the Holder and Minkowski inequalities and by virtue of 3/2 = 1 + 1/2 

E[sup \q t {0) ~ qt(e)\ 2/3 ] < c(E[\\X t \\ + ||/*|| e + WfeWe} 2 )^ 

x(E[||^-^||e]+E[||/*-/*||e]) 2/3 
(5.5) < C' (]>>,(/)+ a,- (M)] ) 2/3 , 

3>t 

with C > not depending on 6 and t. Now, consider for n G N*, 

:= ^ -sup| g t (0) - q t (0)\. 



t=i 



t flee 



Applying the Kronecker lemma (see Feller [14j . p. 238), if limn^oo S n < oo 
a.s. then — • \\L n — L n ||e 0. Following Feller's arguments, it remains 

n n—*oo 

to show that for all e > 0, 



In G N, 3m > n such that jS™, - S n \ > e) := ¥(A) = 0. 
Let e > and denote 

for m > n. Notice that A = HneN Um>n Are,n- For n 6 N*, the sequence 
of sets (An,n)m>n is obviously increasing, and if A n := [j m>n A m ^, then 
limm^oo P(j4 mj „) = P(j4 n ). Observe that (A n ) n£ ^ is a decreasing sequence 
of sets and thus, 

lim lim P(^ m , n ) = lim ¥(A n ) = F(A). 

n— >oo m— >oo n— >oo 
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It remains to bound ¥(A mn ). From the Bienayme-Chebyshev inequality, 



s (^ m , n )=p( V ~su V \q t {6)-q t {6)\>e 
\=„+i * 



1 m -t 

<^73 E [( E T 8UP|&(«0-ft(*) 



£ 

1 

^73 



t=n+l 
m i 

tV3 



t=n+l 



sup | q t (0) - q t {6) 



2/3-, 



2/3 



Using (|5.5p and condition (|3.4p . since £ > 3/2, there exists C > such that 

oo 2/3 

($>,(/) + ay (JJf) + < ' 



$2(/-l)/3 ' 



Thus, t" 2/3 E[sup|gi(0)-ft(0)| 2/3 l< C(t- 2£ / 3 ) for some C > and 



E 

t=i 



i 



E 



sup |<f t (0) - g t (0) 
flee 



2/3 



< co as £ > 3/2. 



Thus lim„^oo lim m ^oo P(^4 mjn ) - 

n^oo 

(ii) See Proposition 2.1. of Jantheau |19j . 



1 



and - • \\L n - L n \\e 
n 



5.4. Proof of Theorem^ Let V be a Banach space (thereafter V = M m 
or V = Mm) and P^ 2 ^C(0, V) denote the Banch space of F-valued 2 times 
continuously differentiable functions on O equipped with the uniform norm 



bll(2),e — WdWe + 



8g 



86 



+ 



d 2 g 



0689' 



We start by proving the following preliminary lemma: 

Lemma 2 Let 6$ belong to 0(r) (r > 2) and assume that (A3(f)) and 
(A3(M)) or (A3(H)) hold. Then 

f e £ h r (V^C(Q,R m )) and E\ £ U'' 2 (V^C{Q,Mm))- 

In view of the results of Lemmas [T] and [51 the functions 8L n {6) / 86 and 
8 2 L n {6)/86 2 are measurable and a.s. finite for all 6 G 0. Their asymptotic 
properties are described in the next two lemmas 
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Lemma 3 Let 9q belong to 0(r) (r > A) and assume that (A3(f)) and 
(A3(M)) or (A3(H)) hold, then 



(5.6) 



n 



1 ^ 2 dL n (6 ) x> 



80 



where G(9q) = (G(^o))l<ij<d is finite and its expression is given in (I5.14|) . 

Lemma 4 Let 9q belong to 0(r) (r > A) and assume that (A3(f)) anc 
(A3(M)) or (A3(H)) hold, then 



(5.7) 



1 d 2 L n {9) 8 2 L{9) 



n 8989' 



8989' 



, 8 2 L(9) 1 
^ with — y- := — E 
e n^oo 8989' 2 



8 2 q { 



8989 



We postponed the proofs of Lemmas CDH] to the end of the Section and 
continue with the proof of Theorem El From Theorem [H we have 



(5.8) 



9n ^ 00- 

n— >oo 



Since 0q €0, a Taylor expansion of 8L n (9o)/89i G R implies 



(5.9) 



8L n (9 n ) 8L n (9 ) , <9 2 L n 



d0 ? ; 



<90; 



+ 



d0d0,- 



"(0n — 0o), 



for n sufficiently large such that the 9 n ^ £ 0, which are between 9 n and 
0o for all 1 < i < d. Using equations (|5.7|) and (|5.8|) . we conclude with the 
uniform convergence theorem that 



'( 



1 8 2 L n {9 n ^ 
n 8989i 



Ki<d ra^oo 



F(9 ). 



One obtains {F(9 )).. = K\d 2 qo(9o)/89 i d9 j \ for 1 < i,j < d. With similar 



arguments as for (|5.13p . since X t — fL = Mg ^ t , with £ t independent of 



!)•••/! 



E 



- /Jo)' ( X * ~ /Jo) 



2E 



Tr((^J ) 



90j 00^ 



00^0,; 



^From equation (I5.15p . we then derive the explicit expression 



'5/Jn 



(5.10) (iW) y = E[2(-^)(l4) 



-1^/J 



30,; 



+ 



Tr(K) 



50; 90, • 
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Under Assumption (Var), F(9q) is a positive definite d x d matrix. Indeed, 
for allF = ( yi ,...,y d ) 



Y'F(9 )Y = Eh( J2 V 



Ki<d 



09, 



Ki<d 



("U 2 ( E y 

Ki<d 



These two terms are nonnegative and at least one of them is positive under 
Assumption (Var). Then F{9q) is an invertible matrix and there exists n 
large enough such that F n is an invertible matrix. Moreover, (|5.9p implies, 

0L n (9 n ) 0L n (9 )s 



Therefore, if 



n(d n -e ) = -2F- 1 ( . ){} 
1 0L n (9 n 



06 



00 



v 



0, using Lemma [3] one obtains Theorem 



El Since — n ^ n = (9 n is a local extremum for L n ), 



09 



(5.11) 



E 



r 1 


0L n 


0L n 






09 


09 


G- 



0. 



Using the relation (|5.12p . the following inequality 

\a\bici - a 2 b 2 C2\ < \a\ - «2 1 1 &2 1 1 C2 1 + kl||&i - &2 1 1 c 2 1 + |ai||Z>i||ci - c 2 | 
and the bounds HCH^He < =HT 1/m , IK^'le < 2£~ 1/m , one obtains: 



0q t {9) 0q t (9) 



09i 



Q9i 



< 



dfe dfi 



e 



+2 







90, 


e 



t\-l/£H\-l 



[HIT ~(Hl) 



Q9i 09i 

Xt — /e|| e + \\fe ~ fe\\e 



09,, 



e 



d(Ht 



-1 



+11^" _ /ellell^ ~ fe\\pt 



o(Ht)- 1 oiHty 1 



09 t 



+ 



09, 



+ 
e 



09i 
t\-i 







e\\e 



e 

d(#, 



90,- aft 







09, 







Under (A3(f)) and (A3(M)) or (A3(H)), there exists C > such that 



E||/^|r e <C(X «,(/)) andE 

3>t 



09j 09i 



<c(E4 1] (/) 



3>* 
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The differences E\\H% - H%\\% < C[^2 a j( M )) 

can also be bounded: 



r/2 



E 



^<<(E«iW) r +(E«? ) w 

3>t j>t 



E 



dOi d6i 



r/2 



ddi 



e 



//. . r/2 , . . f -.\ \ r/2 

<c((^a i (M)) 



Finally, using Holder inequalities, it exists another constant C > satisfying 



E 



80, 



<Cj2Mf) + oc 3 iM) + aj (H) 



3>t 



+ a { l ) (f) + a) 1 >(M) + a) 1 >(H)) 



.,(!) 



(!)/ 



1 A |iagt(«>) 9g t (fl) 
Under rai _g E |_-_ 



n— >oo 



0, and Theorem [2] follows. 



Proof of Lemma\M Here, we focus on the case of Hq under (A3(f)) and 
(A3(M)). The other cases are simpler. 

With the same method and notation as in the proof of Lemma [U the 
result holds as soon as the function 6 £ — > Hq' p is proved to satisfy a 
Cauchy criterion in E r ^ 2 {T>^C(Q, M m )). Using the proof of Lemma [TJ we 

t V T"/2 

already have E||i? e || e < oo. It remains to bound the quantities 



E 



dH, 



r/2 



and E 



r/2 



Vi.jG {!,... ,d}, VpGN*. 



Using Assumption (A3(M)): 



dH, 



t.p 



89,, 



< 2\\M% P 



e He 

oo 



dM, 



t.p 



e 



< {\\Mg(0)\\e + J2»3(M)\\Xt-,\ 

3 = 1 



dM 9 (0) 



+ Y. a f( M )\\ x t-3 







3=1 



Using E[||Xo|| r ] < oo and the Holder and Minkowsky inequalities: 

1/2 



E 



U\ dH e P 


r/2-. 




- 



<c(||M e (O)|r +E[||X o |n(£a,(M))'' 



3=1 
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dM 9 (0) 



e 



+ E[||Xo|r](5>( 1) (M)) 



1/2 



In the same way, there exists another constant C > such that 



E 



d 2 Hl; p 



ddiddj 



r/2 

e 



<c[((J2af\M)Y(j:af\M)) 

j=l 3=1 

oo oo 

+ ((E«iW) r (E«f W) 

i=i i=i 



1/2 



A 1/2 



/.From E 3 aj(M) < oo, ^.^(Af) < 00 and Sj«j Z; ( M ) 

< oo we deduce 

] < oo for all p G N*. In the same way as in the proof of 



( 2 ), 



that EHI-fr 



t,P\\r/2 

l(2),e 



LemmaUwe can also prove that the sequence (H t g ' p ) pe ^* satisfies the Cauchy 
criterion in the Banach space h r / 2 (V^C(e,M m )). For the first derivatives, 
the result easily follows from the inequality 



8HY 









< 2||M*' P -M*' 9 || e 



e 



8M, 



+2||M*' 9 || e 
e 



dH^ OH, 



t,q 



e 



For the second derivatives, a similar argument finishes the proof. 
Proof of Lemma\^ Simple calculations give the relations 



QW 1 



d9 k 



H, 



dO, 



and 



d In det (Hi 



89 k 



Trim 



/From Lemma[21 df$/dO, dH\ /dO and (Hj) are a.s. finite. Then dL n (6) /d6 



is an a.s. finite measurable function satisfying, for all 1 < i < d, dL n {6) / d6i 
l 

2 



(5.12) 



dgt{0) 
80 k 



Denoting T t = a(Xt,X t -i, . . .), let us prove that 

\ oo 

valued martingale difference process. Indeed, for all t E Z, 

E((X t - f 6o )\T t ) = and E((X t - f eo ){X t - fJ\F t ) = H ( 



is a 



t 

Oo- 



2G 
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As a consequence, 
>dq t (e 



E(^|^)=E((X t -4)' 9( ^ rl 



09 k 



We conclude by noticing that the first term of the sum is equal to 



ETc 



(X t -f eo )(X t -f 6o )')\F t )=Tr 



w* 1 



de k 



m 



In order to apply the Central Limit Theorem for martingale-differences, see 

dqtiOo) ^ 



[3] , we have to prove that E 
M% & for all i € Z, then 



06 



< oo. Using the relation Xt — f\ 



9» 



ggt(go) 
96u 



+ Tr((^J 



So 



Let us compute the expectation of the square of the second term of the sum, 
with Tr(ABC) = Ti{CAB) = Tr(ACB) for symmetric matrices A, B and 
C, 



am 



Tft 

(5-13) E[(^) 2 Tr(M^;(^J- 1 ^(^J- 1 -^( J ^ o )- 1 M* 



E 



(&*) a TJr((fl£,)~ 2 ( 



Using this relation, the bound \\(Hg o ) 1 \\q < H 1//m and the independence 
of £t and Tt, there exists C > such that 



E 



ggt(go) 
50, 



<C E 



Ml 



xE[||6|| 2 ] +E 



om 



+E[||& t || 2 ] x E 



OH, 



e 



Therefore, since r > 4, the moment conditions for the CLT are fulfilled 

d 



E 



dq 



06 



k=l 



ftft(flo) 



< OO. 
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dqttfo) 



We compute the asymptotic covariance matrix of 



80 



-. Thus, (G(0 o ))i 



rdq t (e ) dq t (0 ) 



86, dOj 
'9 ft 



6>o 



86 \ > K ° 0/ V ddj 
(5.14) +p ( m4 + (p-l))Tr(( J ff* ) 



Tr (Hi 



00,- 



To simplify the expression, we assume here that £t and — & have the same 
distribution in order that E [£t££-^£t] = f° r ^ a ma trix. 

Proof of the Lemma 0. ^From the proof of Proposition [1] and from the 
result of Lemma [H the second derivative process (8 2 qt(6) / 86 2 ) t ^z is sta- 
tionary ergodic (it is a measurable function of Xt, -X*_i, . . .). Therefore it 
satisfies a Uniform Law of Large Numbers (ULLN) if its first uniform mo- 
ment is bounded. 



/From equation (|5.12p . the second partial derivatives of qt(0) are 

d 2 q t (e) n( d 2 fl 



86,86 j 



<W {Hlrl{Xt - n) 



+ {Xt ~ ft 



86,863 



r<-/»)-((i)'^ 



+ 



86i > 86 j 
(X t -f )+2[—)(H e ) [— 



86 j ) 86 



(5.15) 



Therefore, using the bound 1 || Q < M_ of Lemma Q] and usual 

relations between norms and traces of matrix, there exists C > such that 

d 2 Qt(0) 8 2 f\ , dHl 8 ft , 8Hl dfi 



+ 



< C 



8 2 m 



ddiddj 



+ 



e 



86 3 



d6 t 



+ 



06, 



86 { 86j 



\ x t - fe\\e + 



dft df. 



06, 



e 



804 



e 



+ 



e 

8m 



d6i 



86, 



e 



dm 



804 



G 
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We conclude that E 



d 2 g t (e) 



r/4 

e 



< oo (r > 4) since, for t € Z, 1 < i,j < d, 



E[\\X t \\ r ] <+oo,E[||/*|| T e ] <+oo,E 

r/2 



de,. 



G 



< +oo,E 



9 2 n 



E 



H 



< +oo,E 



3R\ r/2 
6 



d9i 



< +cx>,E 



d 2 H\ r/2- 




< oo. 



< +oo; 



As a consequence, the ULLN holds for d 2 qt{9)/d9 2 . 
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